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Abstract 

The process by which new ideas, innovations, and behaviors spread through a large social network 
can be thought of as a networked interaction game: Each agent obtains information from certain number 
of agents in his friendship neighborhood, and adapts his idea or behavior to increase his benefit. In this 
paper, we are interested in how opinions, about a certain topic, form in social networks. We model 
opinions as continuous scalars ranging from to 1 with 1 (0) representing extremely positive (negative) 
opinion. Each agent has an initial opinion and incurs some cost depending on the opinions of his 
neighbors, his initial opinion, and his stubbornness about his initial opinion. Agents iteratively update 
their opinions based on their own initial opinions and observing the opinions of their neighbors. The 
iterative update of an agent can be viewed as a myopic cost-minimization response (i.e., the so-called 
best response) to the others' actions. We study whether an equilibrium can emerge as a result of such 
local interactions and how such equilibrium possibly depends on the network structure, initial opinions 
of the agents, and the location of stubborn agents and the extent of their stubbornness. We also study 
the convergence speed to such equilibrium and characterize the convergence time as a function of 
aforementioned factors. We also discuss the implications of such results in a few well-known graphs 
such as Erdos-Renyi random graphs and small-world graphs. 

I. Introduction 

Rapid expansion of online social networks, such as friendships and information networks, 
in recent years has raised an interesting question: how do opinions form in a social network? 
The opinion of each person is influenced by many factors such as his friends, news, political 
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views, area of professional activity, and etc. Understanding such interactions and predicting how 
specific opinions spread throughout social networks has triggered vast research by economists, 
sociologist, psychologies, physicists, etc. 

We consider a social network consisting of n agents. We model the social network as a graph 
Q(V,S) where agents are the vertices and edges indicate pairs of agents that have interactions. 
Agents have some private initial opinions and iteratively update their opinions based on their own 
initial opinions and observing the opinions of their neighbors. We study whether an equilibrium 
can emerge as a result of such local interactions and how such equilibrium possibly depends on 
the graph structure and initial opinions of the agents. In the interaction model, we also incorporate 
stubbornness of agents with respect to their initial opinions and investigate the dependency of 
the equilibrium on such stubborn agents. Characterizing the convergence rate to the equilibrium 
as a function of graph structure, location of stubborn agents and their levels of stubbornness is 
another goal of the current paper. 

A. Related Work 

There has been an interesting line of research trying to explain emergence of new phenomenon, 
such as spread of innovations and new technologies, based on local interactions among agents, 
e.g., [(HI, IfTOl . iTTTi . Il27ll . Roughly speaking, a coordination game is played between the agents 
in which adopting a common strategy has a higher payoff. Agents behave according to a 
noisy version of the best-response dynamics. Introducing the noise eliminates the possibility 
of multiple equilibria and drives the system to a particular equilibrium in which all agents take 
the same action IfTOl . ifTTTl . Il27l . In particular, ifTTTl studied the rate of convergence for two 
scenarios of extreme interaction, namely, a complete graph and a ring graph, and showed that 
the dynamics converges very slowly in the complete graph and very fast in the ring network. 
Reference ll27l studies the convergence time for general networks and establishes similar results 
that show highly-connected non-local graphs exhibit slow convergence and poorly connected, 
low dimensional graphs exhibit fast convergence. 

There is a rich and still growing literature on social learning using a Bayesian perspective 
where individuals observe the actions of others and update their beliefs iteratively about an 
underlying state variable, e. g., llT3l . lfT4ll . [fT5l . There is also opinion dynamics based on non- 
Bayesian models, e. g., those in JT), B3, 0, B, [Q2]|, OH. In particular, [16] investigates 
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a model in which agents meet and adopt the average of their pre-meeting opinions and there 
are also forceful agents that influence the opinions of others but may not change their opinions. 
Under such a model, and assuming that even forceful agents update their opinions when meeting 
some agents, |[T6ll investigates convergence to the average of the initial opinions and characterizes 
the amount of divergence from the average due to such forceful agents. As reported in |[T6l . 
it is significantly more difficult to analyze social networks with several forceful agents that 
do not change their opinions and requires a different mathematical approach. Our model is 
closely related to the non-Bayesian framework, this keeps the computations tractable and can 
characterize the equilibrium in presence of agents that are biased towards their initial opinions 
(the so-called partially stubborn agents in our paper) or do not change their opinions at all (the 
so-called fully stubborn agents in our paper). The recent work IfTTl studies opinion dynamics 
based on the so-called voter model where each agent holds a binary 0-1 opinion and at each 
time a randomly chosen agent adopts the opinion of one of his neighbors, and there are also 
stubborn agents that do not change their states. Under such model, [17J shows that the opinions 
converge in distribution and characterizes the first and the second moments of this distribution. 
In addition, our paper is also related to consensus problems in which the question of interest 
is whether beliefs (some scalar numbers) held by different agents will converge to a common 

value, e.g., ED, ED, fM, El, E2. 

B. Contributions 

Our first set of results, Lemmas [T] and [2| are rather straightforward characterizations of 
equilibrium and convergence time when there are no stubborn agents. These results are analogs 
of well-known convergence results for the probability distribution over the states of a Markov 
chain. In this case, our model reduces to a continuous coordination game and the (noisy) best- 
response dynamics converge to a common opinion in which the impact of each agent is directly 
proportional to his degree in the social network. The analysis of the convergence speed, in such 
a continuous coordination game, reveals conclusions that are different from those in EEL E71l 
in the context of a two-strategy coordination game. The convergence of best-response dynamics 
in highly connected non-local graphs, like the complete graph, occurs at a faster speed than the 
convergence in poorly connected local graphs like the ring graph. 

Our second set of results are concerned with social networks in which some of the agents are 
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fully/partially stubborn. In this case, the best-response dynamics at each agent converges to a 
convex combination of the initial opinions of the stubborn agents (Lemma [3]). The impact of each 
stubborn agent on such an equilibrium is related to appropriately defined hitting probabilities 
over a modified graph Q(V, £) of the original social network Q(V, 8). We also give an interesting 
electrical network interpretation of the equilibrium (Lemma [4]). Since the exact characterization 
of convergence time is difficult, we derive appropriate upper-bounds (Lemma |6j Lemma [7]) 
and a lower-bound (Lemma [8]) on the convergence time that depend on the structure of the 
social network (such as the diameter of the graph and the relative degrees of stubborn and non- 
stubborn agents), and the location of stubborn agents and their levels of stubbornness. Based on 
such bounds, we study the convergence speed in social networks with different topologies such 
as expander graphs, Erdos-Renyi random graphs, and small-world networks. 

Finally, in concluding remarks, we discuss the implication of our results in applications where 
limited advertising budget is to be used to convince a limited number of agents in social networks 
to adopt, for example, a certain opinion about a product/topic. Such agents may in turn convince 
others to change their opinions. Our results shed some light on the optimal selection of such 
agents to trigger a faster spread of the advertised opinion throughout the social network. 



C. Organization 

The organization of the paper is as follows. We start with the definitions and introduce our 
model in Section |n| In Section III we investigate opinion dynamics in social networks without 
any stubborn agents. We consider social networks with at least one stubborn agent in Section 



IV Section M contains our concluding remarks. The proofs of the results are provided in the 



appendices at the end of the paper. 



D. Basic notations 

All the vectors are column vectors. x T denotes the transpose of vector x. A diagonal matrix 
with elements of vector x as diagonal entries is denoted by diag(:r). x max means the maximum 
element of vector x. Similarly, x min is the minimum element of vector x. t n denotes a vector 
of all ones of size n. 
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II. Model and Definitions 

Consider a social network with n agents, denoted by a graph Q(V,£) where agents are the 
vertices and edges indicate the pairs of agents that have interactions. For each agent i, define 
its neighborhood di as the set of agents that node i interacts with, i.e., di := {j : E £}. 
Each agent i has an initial opinion 2,(0). For simplicity we assume that the initial opinions are 
some numbers between and 1. For example, 2^(0) 's could represent the people opinions about 
the economic situation of the country, ranging from to 1 with an opinion 1 corresponding 
to perfect satisfaction with the current economy and representing an extremely negative view 
towards the economy. Let x(0) := [xi(0) ■ • ■ x n (0)] T denote the vector of initial opinions. We 
assume each agent i has a cost function of the form 

Ji{xi, x 8i ) = - ^{xi - xj) 2 + ^Ki(xi - Xi{0)) 2 , (1) 

that he tries to minimize where Ki > measures the stubbornness of agent i regarding his 
initial opinion^ When none of the agents are stubborn, correspondingly Ki's are all zero, the 
above formulation defines a coordination game with continuous payoffs because any vector of 
opinions x = [x% ■ ■ ■ x n ] T with xi = X2 = • • • = x n is a Nash equilibrium. Here, we consider 
a synchronous version of the game between the agents. At each time, every agent observes the 
opinions of his neighbors and updates his opinion based on these observations and also his own 
initial opinion in order to minimize his cost function. It is easy to check that, for every agent i, 
the best-response strategy is 
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where di = |<9j| is the degree of node i in graph Q. Define a matrix A nxn such that — , 
for E £ and zero otherwise. Also define a diagonal matrix B nxn with Ba = d ._^ K . for 

1 < i < n. Thus, in the matrix form, the best response dynamics are given by 

x(t + 1) = Ax(t) + Bx(0). (3) 

'Although we have considered uniform weights for the neighbors, the results in the paper hold under a more general setting 
when each agent puts a weight Wij for his neighbor j. 
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Iterating shows that the vector of opinions at each time t > is 

t-i 

x(t) = A*x(0) + ^ A s .Bx(0). (4) 

In the rest of the paper, we investigate the existence of equilibrium under the dynamics p]) in 
different social networks, with or without stubborn agents. We also characterize the convergence 
time of the dynamics, i.e., the amount of time that it takes for the agents' opinions to get close to 
the equilibrium. The equilibrium behavior is relevant only if the convergence time is reasonable 

ED. 

III. No Stubborn Agents 

Convergence issues in the case of no stubborn agents is a special case of consensus, and has 
been well studied. Here, we briefly review this work to put our later results in context. This also 
allows us to compare the results in IfTTll to continuous opinion dynamics. 

When there are no stubborn agents in the social network, i.e., all ifj's are zero, A is a row- 
stochastic matrix and B = in ([3]). Without loss of generality, assume that A is irreducible 
which corresponds to Q being a connected graph. (Otherwise, A can be simply viewed as a 
collection of diagonal sub-matrices with each sub-matrix describing the opinion dynamics on 
one of the disconnected subgraphs of £?.). For now, further assume that A is primitive, i.e., there 
is a constant t such that all elements of A 1 are strictly positive for all t > t . It is easy to show 
that A is primitive if and only if the graph Q is not bipartite, i.e., there is both an odd cycle and 
an even cycle from every node to itself (we will later discuss the case of bipartite graphs). 

A. Existence and characterization of the equilibrium 

By the Perron-Frobenius theorem, the eigenvalues of A are such that 1 = Ai > |A 2 | > • • • > 
|A n |. The right eigenvector corresponding to Ai = 1 is 1„ up to a normalization constant. Let n 
be the left eigenvalue of A which is unique up to a normalization constant. 

Using the eigen-decomposition of A (or Jordan normal decomposition if eigenvalues are not 
distinct), it is well-known that lim^oo A 1 = t n n T up to a scalar multiple. In fact, since A 1 is 
row-stochastic, Y^i=i^i = 1- Hence, n can be interpreted as the unique stationary distribution 
of a Markov chain with transition probability matrix A, so A 1 must converge to the matrix with 
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all rows equal to tt t . Hence, the equilibrium under dynamics ^ is unique and simply given by 

x(oo) := lim x{t) = l n 7r T x(0). (5) 

t— >oo 

This shows that in equilibrium, agents will reach a consensus, i.e., all opinions are eventually 
the same and equal where Xj(oo) = YH=i ^^(O), for all i E V. 

Note that A can be interpreted as transition probability matrix of a random walk over the graph 
Q with edge weights equal to one. It is easy to check that such random walk is reversible and 
the stationary distribution of the random walk (i.e., left eigenvector of A corresponding to the 
eigenvalue 1) is simply 7Tj = di/2\£\, i E V. Hence, the impact of each agent on the equilibrium 
consensus is directly proportional to its degree. We state the result as the following lemma. 

Lemma 1. In a social network Q with no stubborn agents, and initial opinions vector x(0), the 
best response dynamics will converge to the following unique equilibrium 




where di is the degree of agent i. 
B. Convergence time 

First, we introduce a convenient norm on IR n that is linked to the stationary distribution n of 
the random walk on the social network graph. Let £ 2 (ti) be the real vector space M. n endowed 
with the scalar product 

r 
8=1 

Then, the norm of z with respect to n is defined as 

INk := I ^«(i)M*) 
\i=i 

Define the error as the vector 

e(t) := x(t) - x(oo). (7) 

The following lemma states that the error goes to zero geometrically at a rate equal to the second 
largest eigenvalue modulus of A. 
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Lemma 2. Under the best-response dynamics, 

||e(*)IU<p!l|e(0)|U. (8) 
where p 2 := max^i |Aj| is the SLEM (Second Largest Eigenvalue Modulus) of A. ^ 

See Appendix |A| for the proof. We define the convergence time t(v) as 

t(u) = inf{t > : ||e(t)|| w <i/}, (9) 

where < v <C 1 is some small positive number. 

It can be seen that under the 7r-norm, Ue^))^ = Var 7r (e(t)), i.e., the variance of e(i) with 
respect to distribution n. This ensures that || e(0) || ^ < 1 even when n — > oo because we assumed 
that initial opinions are bounded between zero and one. A simple calculation, based on Lemma 
[2} reveals that 

1 _A log »U rM < i lo /N°)IU 



1 — p 2 J \ v ) 1 — p 2 

In particular, the convergence time is as me number of agents n grows. 

C. Bipartite networks and noisy opinion dynamics 

Next, we consider the case that the social network is bipartite. One important example of 
such networks is a ring network with an even number of agents n. The ring graph is formed by 
placing the agents on a circle and connecting each agent to two of his nearest neighbors. In this 
case, the best-response dynamics do not converge to an equilibrium. For example, for the case 
of the ring network with n even, matrix A is simply 

1/2 if \i — j\ — 1 or n — 1 

otherwise. 

Then, it is easy to see that, as t — > oo, A 1 alternates between two matrices for t even and t odd, 
in fact, for t odd, 

f±\ 2/n if \i — j\ = 1 mod 2, 
KmA%={ 

1 otherwise 

2 In Euclidian norm, ^7v min \\e(t)\\2 < ||e(t)||, < v / n max \\e(t)\\ 2 , and so ||e(i)|| 2 < P2y%^\\e(0)h, where d max = 
max, di and d m i n = mini di . 



Aij 
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and for t even, 



lim A 



(t) 



2/n if \i — j\=0 mod 2 



otherwise. 

This shows that, as t — > oo, the opinion of each agent i does not converge and alternates between 
two values. The opinion of agent i at an odd t will be the average of the initial opinions of the 
agents {j : \i — j\ = 1 mod 2} and at even t, it will be the average of the initial opinions of 
the agents {j : \i — j\ = mod 2}. 

In practice, not everyone completely ignores his own previous opinion and might be slightly 
biased by his old opinion. Hence, we can consider a noisy version of the best-response dynamics 
as follows 



(* + !) = (!- e) Q- + (10) 



for some self-confidence e > 0. Here, we assume all agents have the same self-confidence 
but the argument can be adapted for different self-confidences as well. Introducing such self- 
confidences, adds self-loops to graph Q which ensures that Q is not bipartite, or, correspondingly, 



is primitive where A\j = e if j — i and A-^ = (1 — e)/dj if j G <9j. Hence, using the results 
in the previous section, the noisy best-response dynamics will converge to 

n 

xf(oo) = ^vr^x^O); for all i G V, 

where the unique stationary distribution of the Markov chaii£] with 

transitic 
Hence, 



transition probability matrix A^ e \ By reversibility of A^ e \ rc^ = iii = ^ independently of e 



xf\oo) = Xj(oo) = — j^rr y^rfjXj(Q), for all i G V, 



1 1 i=i 

i.e., agents will converge to the same equilibrium as in the non-partite case. 

To investigate the convergence rate, note that A^ = el + (1 — e)A, so Af' 1 = e + (1 — e)Aj(A). 
Especially, = e + (1 — e)X 2 (A) and An = — 1 + 2e because X n (A) = — 1 for random 
walk on bipartite graph. Hence, as far as the scaling law with n concerns, the convergence 

time is 0( — K^r) for pi = maxiAn 6 '*, I A^"* I}, which, for fixed e, means that the convergence 

\1-Pa / 



3 The terminologies random walk and Markov chain can be used interchangeably here. 
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time is 6 




', we can consider the noisy best-response dynamics for the non 



partite graphs. Again, introducing self-confidence in opinion dynamics does not change the 
equilibrium. Moreover, the second largest and the smallest eigenvalues will be respectively given 
by A2 = e + (1 — e)X 2 (A) and An > — 1 + 2e. Hence, the convergence time is again of the 



Hence, the convergence time of the best-response dynamics is determined by \2(A) of the 
corresponding random walk over the social graph. 

Example 1. In this example, we make a comparison between ring graph and complete graph 
with n nodes. The complete graph represents situation when all agents can communicate with 
each other with no constrains, while in the ring graph, each agent can only communicate with 
his two nearest neighbors. Qualitatively, the complete graph and the ring graph represent two 
extreme ends of the spectrum of graphs Note in both cases the (noisy) best-response dynamics 
converge to the average of initial opinions. It is easy to see that Xz^A) is for the complete 
graph and cos(^) ~ 1 — \ for the ring. Hence, while both of the graphs have the same 
equilibrium, convergence in the complete graph is much faster than convergence in the ring, in 



It is interesting to compare our continuous coordination game with a two-strategies coordi- 
nation game in Ellison [11J where agents behave according to a noisy best-response dynamics. 
Introducing the noise eliminates the possibility of multiple equilibria and leads to convergence to 
the "risk dominant" strategy throughout the network. He studied the rate of convergence for the 
complete graph and the ring graph and showed that the dynamics converges very slowly in the 
complete graph and very fast in the ring network. This is in total contrast with the above example 
as we observe that, in a continuous coordination game, the best-response dynamics converge 
faster in the complete graph compared to the ring graph. This can be justified by noticing that 
the mechanism for spreading a common strategy throughout the network is inherently different in 
the continuous and the two-strategy coordination game. In the two-strategy coordination game, 
existence of a sufficiently large cluster of agents playing the risk-dominant strategy needed in 
order to prevail the risk-dominant strategy throughout the network. As Elision stated, in the ring 
network, the required size of such clusters is very smaller than the required size of clusters for 
the complete graph. Hence, it takes an extremely long time to see such clusters in the complete 




fact, 0(1) vs. 0(n 2 ). 
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graph starting from arbitrary initial conditions. In the continuous coordination game, the (noisy) 
best-response dynamics converge to the average of initial opinions in both graphs. In the complete 
graph, after the first iteration, the opinion of each node is the average of the initial opinions 
of all agents excluding its own opinion which has little importance especially when n is large. 
In the ring graph, averaging the initial opinions of an agents 's neighbors could still be very far 
from the average of all the initial opinions and increasing n will make this gap even larger. 

There is a rich literature on approximating A 2 (^4) of a random walk over different types of 
graphs, e.g., see Chapter 2 of 01 for a survey. Intuitively, the convergence time is dominated 
by the highly connected component of the graph which is loosely connected to the rest of 
the network (captured by the notion of conductance of the Markov chain Q, or the edge 
isoperimetric function of the graph). For example, expander graphs have fast convergence (with 
a convergence time independent of n) because the number of connections from every subgraph, 
of size less than n/2, to the rest of the network is at least a constant fraction of total connections 
within the subgraph independent of n. We do not proceed in this direction further and in the 
next section, we study the more interesting case of social networks with stubborn agents. 

IV. Impact of Stubborn Agents 

A. Existence and characterization of equilibrium 

Consider a connected social network Q(V,£) in which at least one of the agents is stubborn, 
i. e., Ki > for some i 6 V. Then A is an irreducible sub- stochastic matrix with the row- 
sum of at least one row less than one. Let pi(A) := maxj |Aj(A)| denote the spectral radius 
of A. It is well-known that p\{A) of a sub- stochastic matrix A is less than one, and hence, 
lim^oo A 1 = 0. Therefore, by Perron-Ferobenius theorem, the largest eigenvalue should be 
positive, real 1 > Ai > and pi(A) = Ai. Hence, in this case, based on the equilibrium 
exists and is equal to 

oo 

x(oo) := limx(t) = V#Si(0) = (I - A) _1 Sx(0). (11) 

s=0 

Therefore, since Ba = for all non-stubborn agents i, the initial opinions of non-stubborn agents 
will vanish eventually and have no effect on the equilibrium ( fTTj ). 

The matrix form ( fTT| ) does not give any insight on how the equilibrium depends on the graph 
structure and the stubborn agents. Next, we describe the equilibrium in terms of explicit quantities 
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that depend on the graph structure, location of stubborn agents and their levels of stubbornness. 

Let S C V be the set of stubborn agents and |<S| > 1. Any agent i in S is either fully 
stubborn, meaning its corresponding K t = oo, or it is partially stubborn, meaning < Ki < oo. 
Hence, S = Sp U Sp where Sp is the set of fully stubborn agents and Sp is the set of partially 
stubborn agents^] Without loss of generality, index the partially stubborn agents with 1, • • • , |<Sp|, 
index the fully stubborn agents with |<Sp| + 1, • • • , |<S| and finally the non-stubborn agents with 
|«S| + 1, • • • , n. Next, we construct a weighted graph Q(V, £) based on the original social graph 
Q(V,£) and the location of partially stubborn agents Sp and their levels of stubbornness Ki, 
i E Sp. 

Assign weight 1 to all the edges of Q. Connect a new vertex Ui to each i E Sp and assign a 
weight Ki to the corresponding edge. Index the new vertex connected to i E Sp by n + i. We use 
the node Ui and its index n+i interchangeably. Let V := VU{«j : i E Sp} = {1, 2, • • • , n+|<Sp|} 
and £ := £ U {(i,Ui) : i E S P }. Also let iOy denote the weight of edge (i,j) E £. Then Q(V, £) 
is a weighted graph with weights = 1 for all (i,j) E £ (the edges of Q) and w iUi = Ki for 
all i E Sp. Let u(Sp) = {u-i : i E Sp}. 

Define Wi := j)<=s w ij as ^ e weighted degree of vertex i EV.lt should be clear that 

di + Ki for i E Sp, 

di for i E V\S P , (12) 

Kj for i = Uj,j E S P . 

Consider the random walk Y(t) over Q where the probability of transition from vertex i to vertex 
j is Pij = Assume the walk starts from some initial vertex Y(0) — % E V. For any j E V 
define 

Tj :=M{t>0:Y(t)=j}, (13) 
as the first hitting time to vertex j. Also define r := Aje l s F uu(iSj 

s tj as the first time that the 

random walk hits any of the vertices in Sp U u(Sp). The following Lemma characterizes the 
equilibrium. The proof is provided in Appendix [EJ 



4 We need to distinguish between the case < Ki < oo and Ki = oo for technical reasons; however, as it will become clear 
later, the conclusions for Ki — oo are equivalent to those for Ki < oo if we let Ki — > oo 
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Lemma 3. The best-response dynamics converge to a unique equilibrium where the opinion of 
each agent is a convex combination of the initial opinions of the stubborn agents. Based on the 
random walk over the graph Q, 

Xi {oo) = P *( r = T Uj )xj(0) + J2 P *( r = T i) x Mi f° r alll<t<n } (14) 

jeSp j&s F 

where Pj(r = r^), k G Sf U u(Sp), is the probability that the random walk hits vertex k first, 
among vertices in Sf U u(Sp), given the random walk starts from vertex i. 

Note that limx^oo Pi(t = T Ui ) = 1 for any partially stubborn agent % G Sp. This intuitively 
makes sense because as an agent i becomes more stubborn, his opinion will get closer to his 
own opinion and behaves similarly to a fully stubborn agent. 

It should be clear that when there is only one stubborn agent or there are multiple stubborn 
agents with identical initial opinions, eventually the opinion of every agent will converge to the 
same opinion as the initial opinion of the stubborn agents. 

In general, to characterize the equilibrium, one needs to find probabilities Pj(r = r k ), k G 
Sp Uu(Sp). Such hitting probabilities have an interesting electrical network interpretation (see 
Chapter 3 of ||23"10 as follows. Let Q be an electrical network where each edge G £ has a 
conductance (or resistance 1/?%). Then Pj(r = r k ) is the voltage of node % in the electrical 
network where node k G SpUu(Sp) is a fixed voltage source of 1 volt and nodes SFUu(Sp)\{k} 
are grounded (zero voltage). This determines the contribution of the voltage source k where all 
the other sources are turned off. Now let vertices Sf U u(Sp) be fixed voltage sources where 
the voltage of each source i G Sp is Xj(0) volts and the voltage of each source Uj G u(Sp), 
j G Sp, is Xj(0) volts. By the linearity of the electrical networks (the superposition theorem in 
circuit analysis), the voltage of each node in such an electrical network equals to the sum of 
the responses caused by each voltage source acting alone, while all other voltage sources are 



grounded. Therefore, the opinion of agent i, at equilibrium (36), is just the voltage of node i in 
the electrical network model. We mention the result as the following lemma and will prove it 
directly in Appendix [C] 

Lemma 4. Consider Q as an electrical network where the conductance of each edge is 1 and 
each stubborn agent i is a voltage source of Xi(0) volts with an internal conductance Ki. 
Fully stubborn agents are ideal voltage sources with infinite internal conductance (zero internal 
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resistance). Then, under the best-response dynamics, the opinion of each agent at equilibrium 
is just its voltage in the electrical network. 

We illustrate the use of the above lemma through the following example. 

Example 2. Consider a one-dimensional social graph, where agents are located on integers 
1 < % < n. Assume nodes 1 and n are stubborn with initial opinions xi(0) and x n (0), and 
stubbornness parameters K 1 > and K n > 0. Then graph Q consists of the original line network, 
where each edge weight is one, and two extra nodes u\ and u n connected to 1 and n with edge 
weights K\ and K n . Using the electrical network model, the current is the same over all edges 
and equal to I = (xi(0) — x n (0))(-^ + -^+n — l) -1 . Hence, Xj(oo) = Vi = Xi(0) — I(^-+i — l), 

for 1 < i < n, i. e., 

, \ ( K7 1 \ , , / K7 1 +i-l \ , N 



K7 1 + K- 1 +n-lJ u ' \K7 X + + n - 1, 
As K\ increases, the final opinion of i will get closer to stubborn agent 1, and as K n increases, 

it will get closer to the opinion of agent n. 
B. Convergence Time 

Although we are able to characterize the equilibrium in all cases, the equilibrium makes 
sense only if the time needed to converge to equilibrium is reasonable. Next, we characterize 
convergence time in the case that there is at least one stubborn agent. Let e(t) — x(t) — x(oo) 
be the error vector as defined before. Trivially ej(t) = for all fully stubborn agents i E Sf- 
Let e(t) := [e^ (t) : i 6 V\<Sp] T denote the errors for all other agents. The convergence to 



the equilibrium (11) is geometric with a rate equal to largest eigenvalue of A as stated by the 



following lemma whose proof is provided in Appendix |Dj 



Lemma 5. Let n = : i G V\Sp] for the weights Wi as in {12) and Z be the normalizing 
constant such that ^2 ieV \ Sp tt% = 1. Then, 

\\e(t)\\z < (\ A y\\e(0)\\z, (15) 

where Xa is the largest eigenvalue of A. 

Note that in Euclidian norm, y/W~^~\\e(t) || 2 < \\e(t)y < V^max\\e(t)\\ 2 , thus, 



< mJ] 
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where w max : = max^y^ w% and w min := minj 6V \5 F m- 

Hence, the convergence is geometric with a rate at least equal to largest eigenvalue of A. 
Defining the convergence time as the familiar form t(v) := inf{t > : ||e(t)||^ < v} for some 
fixed v > 0, we have 

1 iW^W)<^io g ^(* 



1 — Aj4 / \ V J 1 — \a V v 

so again t(u) = (x^x^") as n grows. Let T := jzy^"- With a little abuse of terminology, we 
also call T the convergence time. 

Since the exact characterization of is difficult, we will derive appropriate upper-bounds 
and lower-bounds for it that depend on the graph structure, the location of stubborn agents and 
their levels of stubbornness. The techniques used in deriving the bounds here are similar to the 
techniques used in deriving geometric bounds for the second largest eigenvalue of stochastic 
matrices IE51. ESI. 



Consider the weighted graph Q(V,£) as defined in Section IV-A A path from a vertex i 
to another vertex j in Q is a collection of oriented edges that connect % to j. For any vertex 
i G V\Sf, consider a path 7« from i to the set Sf U u(Sp) that does not intersect itself, i.e., 

7i = {(Mi), (n,«2), • • • , (im,j)} for some j G Sf U 

Proceeding along the lines of Diaconis-Stroock [|25ll . we get the following bound that yields 
an upper-bound on the convergence time (see Appendix [E] for the proof). 

Lemma 6. Consider the weighted graph Q. Given a set of paths {7^ : i G V\«Sf}, from V\Sf 
to Sf U u(Sp), let \ji\ w := ^(st)^ ^t~ t - Then, the convergence time T < 2£ where 

£ := max ^(x,y), 

(x,y)eS 



and, for each edge (x,y) G £, 



£{x,y) := ^2 w ihi\w (16) 



It is also possible to proceed along the lines of Sinclair Il26ll . This gives a different bound 
stated in the following lemma. 
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Lemma 7. Consider the weighted graph Q(V,£). Given a set of paths {7^ : % G V\<Sf} from. 
V\Sf to Sf U u{Sp), we have T < 2r/ where 



r] := max r](x,y), (17) 

(x,y)e£ 



and, for each edge (x,y) G £, 



r]{x,y):=— V 

in < J 



Wi\li\- (18) 



The above lemma is very similar to the bound reported in ll27ll without proof but differs by 
a factor of 2. The factor 2 is not important in investigating the order of the convergence time; 
however, in graphs with finite number of agents, ignoring this factor yields convergence times 
that are smaller than the actual convergence time. Therefore, we have included a short proof in 
Appendix [E] for the above lemma. 

Intuitively, both £,(x,y) and i](x,y) are measures of congestion over the edge (x, y) due to 
paths that pass through (x,y). In general, computing the upper-bound using Lemma [7] is easier 
than using Lemma [6} 

An upper bound on 1 — A^, and thus a lower-bound on the convergence time T, is given by 
the following lemma whose proof is provided in Appendix [E] 

Lemma 8. Consider the weighted graph Q(V,£), then 

1-X A < min ij(B;Q), (19) 

BCV\S F 

where ijj{B;Q) := g^^ ■ The minimum is achieved for some connected subgraph with 
vertex set B. 

Next, as an example of applications of the above bounds, we study the special cases of the 
complete graph and the ring graph with one stubborn agent. In these cases, Lemma [7] yields 
tighter results and it is also easier to use than Lemma [6} 

Example 3 (Complete graph vs. Ring graph). Assume there is one stubborn agent, node 1, with 
K\ > 0. In each case, construct the weighted graph Q and let 7 = {7^ : i G V} be the set of 
shortest paths from nodes V to u\. For the complete graph, the congestion over (1, ui) is exactly 

r)(l, Ul ) = -?-(K 1 + (n-l) + 2(n-l) 2 ), 
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and the congestion over any other edge (i, 1) : 1 < % < n is simply = n — 1. Hence, 

for large values of K\, the congestion is dominated by (1, U\) and for small values of K\, it is 
dominated by an edge (i, 1), for some 1 < % < n. More accurately, 



T < 




otherwise 



Next, consider a ring graph with odd number of nodes. The congestion over (l,wi) is 

(n-l)/2 

17(1, th) = —(2 + ^ + 2(2 0)- 
1 i=i 

Smce, /or 1 < i < n, 77(7,1,7) < 77(2,1,7), it is enough to find the congestion over the edge 
(2, 1) which is 7/(2, 1) = 2^™7 1 ' )//2 7. This shows that 



2+g 1 + (n 2 -l)/2. . f j, ^ 8+2(n 2 -l) 



T < 



n -1. 



, if K\ < . , _ 

otherwise 



4 ' 

Figure |£] shows the upper-bound in each graph and compares it with the exact value of j^j^ 
calculated numerically for n = 11. As K\ — )■ 00, the stubborn agent approaches a fully stubborn 
agent. 

We can also compute lower-bounds, based on Lemma [8] as follows. The set B that achieves 
the minimum in ( [79] ), either includes node 1 or not. If 1 G B, then it is easy to see that 
minBcv:ie/3 i>{B; Q) = i/j(V; Q) = K ^ 2 \ £ \ in both E ra P hs - Ifl^B, then min B cv:i^B i>{ B \ Q) = 
min B cv:i^B 4>{B; Q). In the case of the complete graph, 

77 — 1 1 

mm ^B-g) = ^{y\{iy,g) = - ( — — 2 = — -, 

bcv-.i^b {n — 1) 1 n — 1 

and in the case of the ring graph, 

min =1>(y\{l};Q) 



Bcy-.i^B 2(n — 1) n 

Hence, the lower bound is the following. For the complete graph 

Ki+n(n— 1) . •/■ TV - n(n—l) 



r > I tf K l - (n-2) 

n — 1; otherwise, 



and for the ring 



2« 



n—1; otherwise. 
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Fig. 1. The comparison of the convergence time between complete and ring graphs with n = 11 nodes with one stubborn 
agent. 



C. Canonical bounds via shortest paths 

Let 7 = {7i : i E V\Sf} be the set of shortest paths from vertices V\Sf to a the set 
5p U u(S P ), so, in fact, for each i E V\5f, 7« = 7^ for some j € 5 F U u(S P ). See Figure [2] 
for an example. Let L, C V\<Sf be the set of nodes that are connected to j E Sp U u(Sp) via 
the shortest paths. Also let I7I := maXj g v\ l s F It«I be the length of maximum of such shortest 
paths and |T| := maxj e ,5 FUu ( l 5 p ) \Tj\ be the maximum number of nodes connected to any node 
in S F U u(S P ). For example, in Figure [2j |T| = 4 and I7I = 3. 

For each partially stubborn agent j E Sp, 

V |7i 



vU,Uj) = jT-iKj + dj + ^di 
d+ lTl|r|d 



^ 1+ AT • ' 

J1 mm 

where := max ig v\,s di is the maximum degree of non-stubborn agents, d := max^s di is the 
maximum degree of stubborn agents, and K min := mmj £ s p Kj is the minimum stubbornness. 
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Fig. 2. A social network consisting of 9 agents. Vertex 1 is a partially stubborn agent and vertex 2 is a fully stubborn agent. 
The colored edges show the shortest paths from the non-stubborn agents to the set of stubborn agents. 



Hence, the congestion is dominated by some edge (j,Uj), j E Sp, only if the stubbornness Kj 
is sufficiently small. 

It is easy to show that all the paths that pass through an edge (x, y) £ £ are connected to the 
same j 6 Sf U u(Sp), or equivalently to the same stubborn agent. So for each (x, y) G E, 

i:7i9(x,v) 

where 

B := max \{i : ^ 3 (x,y)}\, (20) 

(x,y)e£ 

is the bottleneck constant, i.e., the maximum number of shortest paths that pass through any 
link of the social network. It is clear that \Y\/d < B < \Y\ because the maximum bottleneck is 
at least equal to the bottleneck over an edge directly connected to a stubborn agent. Therefore, 
for K min < K* := 7-7^737, f] is dominated by congestion over some edge (j,Uj), j G Sp, and 

T< _J l+ ^mA, (21) 

\ K m i n j 

For K min > K* , rj is dominated by an edge of the social network which is the bottleneck, and 
in this regime 

T < 2\^\Bd. (22) 

Dependence on |7|, in both regimes, intuitively makes sense as it represents the minimum time 
required to reach any node in the network from stubborn agents. Hence, the convergence time in 



20 



general depends on the structure of the social network and the location of the stubborn agents and 
their levels of stubbornness. There is a dichotomy for high and low levels of stubbornness. For 
high levels of stubbornness, and in the extreme case of fully stubborn agents, the opinion of the 
stubborn agent is almost fixed and the convergence time is dominated by the the bottleneck edge 
and the structure of the social network. For low levels of stubbornness, the transient opinion 
of stubborn agent may deviate a lot from its equilibrium which could deteriorate the speed 
of convergence. In fact, for very low levels of stubbornness, this could be the main factor in 
determining the convergence time. It is worth pointing out that adding more fully stubborn 
agents, with not necessarily equal initial opinions, or increasing the stubbornness of the agents 
makes the convergence faster. 



D. Scaling Laws 

In this section, we use the canonical bounds to derive scaling laws for the convergence time 
as the size of the social network n grows. For any social network, we can consider two cases: 
(i) There exists no fully stubborn agent, i. e., all the stubborn agents are partially stubborn (ii) 
At least, one of the agents is fully stubborn. 



In both cases, the upper-bound on the convergence time is given by (21 ) and (22) depending 
on the levels of stubbornness of partially stubborn agents. In case (ii), if all the stubborn agents 



are fully stubborn, then the upper-bound on the convergence time is given by (22). 



To get the lower-bounds, we consider the set B in (19) to include all the nodes V\Sp- This 
gives the following lower-bound for the case (i) 



and, for the case (ii), 



T > 1 + ^ 2|g ' , (23) 
2^jes P A i 

V.., Kj + 2\8\ - y\ c , dj 
T > ' ' ' J£ f F (24) 

In investigating the scaling laws, the scaling of the number of stubborn agents and their levels 
of stubbornness with n could play an important role. In the rest of this section, we study scaling 
laws in graphs with a fixed number of stubborn agents, with fixed levels of stubbornness, as the 
total number of agent n in the network grows. Then, in any connected graph Q, the smallest 
possible lower-bound on the convergence time is T = Vt{n) in the case (i), and T = 
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in the case (ii) which could be as small as Q(l). It is possible to combine the upperbounds 



(21 ) and (22) to obtain a (looser) upper-bound that holds for a fixed number of stubborn agents, 
with any mixture of partially /fully stubborn agents. Let d max be the maximum degree of the 
social graph (possibly depending on n). The upper-bounds show that T = 0{\^\nd max ) for 
K min small enough (i.e., smaller than a threshold depending on the structure of the graph) and 
T = 0(Y)\Bd ma x) otherwise. Recall that B was the bottleneck constant, and obviously B < n, 
implying that T = 0(n\"f\d max ), for a fixed number of stubborn agents consisting of any mixture 
of partially /fully stubborn agents. Furthermore, it should be clear that I7I is at most equal to the 
diameter 8 of the graph, hence, as a naive bound, 

T = 0(n5d max ). (25) 

Dependence on the diameter intuitively makes sense as it represents the minimum time required 
to reach any node in the network from an arbitrary stubborn agent. 



Fastest Convergence 

It should be intuitively clear that a graph Q with a stubborn agent directly connected to n — 1 
non- stubborn agents and with no edges between the non- stubborn agents should have the fastest 
convergence. In fact, if the stubborn agent is partially stubborn (case (i)), construct Q by adding 
an extra node U\ and connect it to the stubborn agent 1 by an edge of weight K\. Then, it 
is easy to check that 77(1, u\) = 1 + 3( ^~^ and r)(i, 1) = 2, 2 < i < n. Hence, T = 0(n), 
and considering the general lower-bound T = Cl(n), T = 0(n) is indeed the sharp order. If the 
stubborn agent is fully stubborn , then r](i, 1) = 1 for all i, thus T < 2 achieving the lower-bound 
in case (ii). 



Complete graph and Ring graph 

For the complete graph, with a fixed set of stubborn agents, d — d — n — 1, |T| = 0(n) and 
I7I = 2 and K* = 0(n). If at least one of the agents is partially stubborn, the upper-bound 
follows from (21) which gives T = 0(n 2 ), and, considering the lowerbound (23), T = 0(n 2 ) 
is the right order. If all the stubborn agents are fully stubborn, the upper-bound follows from 



(22) which is T = 0{n) because obviously B — 1 in the complete graph. Using (24) gives a 
lower-bound so T = 0(n) if there is a fixed number of fully stubborn agents. 
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For the ring network, Q(ri) is a lower-bound in both cases. To get an upper-bound note that 
K* = 0(1), however, B = 0(n), d = d = 2, \T\ = 0(n), and H = 0(n). Hence, for all fixed 
levels of stubbornness, and for any fixed number of fully/partially stubborn agents, T = 0(n 2 ). 

Figure [3] verifies the results above, as we saw, in the case of one stubborn agent with a fixed 
K\, and n large enough (larger than a constant depending on the value of Ki), the ring network 
has a faster convergence than the complete graph. For any fixed n, and K\ large enough, the 
complete graph has a faster convergence than the ring. 



Expander graphs and Tress 

Expanders are graph sequences such that any graph in the sequence has good expansion 
property, meaning that there exists a > (independent of n) such that each subset S of nodes 
with size \S\ < n/2 has at least a\S\ edges to the rest of the network. Expander graphs have 
found extensive applications in computer science and mathematics (see the survey of ll35Tl for 
a discussion of several applications). An important class of expanders are d-regular expanders, 
where each node has a constant degree d. Existence of d-regular expanders, for d > 2, was 
first established in ll37l via a probabilistic argument. There are various explicit constructions of 
d-regular expander graphs, e.g., the Zig Zag construction in ll34l or the construction in ll36ll . 

Recall the naive upper-bound ( |25| ) when there is a fixed number of (fully/partially) stubborn 
agents. So, for any bounded degree graph, with maximum degree d > 2, and diameter 5, T = 
0(n5). It is easy to see that the diameter of a bounded degree graph, with maximum degree 
d, is at least log^^n (Lemma 4.1, Il28l0 . In fact, for a d-regular tree or a <i-regular expander, 
5 = O(logn) |^| Hence, for these graphs, T = 0(n log n) which is almost as fast as the smallest 
possible convergence time VL[n) when there is at least on partially stubborn agent. When all the 



stubborn agents are fully stubborn, T = 0{n\ogn) still holds, by (22) because B = Q{n) in any 
bounded degree graph, but, in this case, the convergence is slow compared to the best possible 
convergence time Vt{l). 

5 To show the latter, consider the lazy random walk over a d-regular expander graph, i.e., with transition probability matrix 
P — H + | where M is the graph's adjacency matrix. Then, it follows from Cheeger's inequality and the expansion property, 
that the spectral gap 1 — ^2(P) > fgz ■ Using the relation between the special gap and the diameter S < ^^"p) 1381 , we get 
8< ^logn. 
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Erdos-Renyi Random Graphs 

Consider an Erod-Renyi random graph with n nodes where each node is connected to any 
other node with probability p, i.e., each edge appears independently with probability p. To ensure 
that the graph is connected, we consider p = for some number A > 1. Assume there 

are a fixed set of stubborn agents with fixed stubbornness parameters. Using the well-known 
results, the maximin degree of an Erdos-Renyi random graph is O(logn) with high probability, 
i.e., with probability approaching to 1 as n grows [|41"|. Also we know that the diameter is 
^ ( io° g g np ) = ^ ( log(Akign) ) w * m m gh probability (in fact, the diameter concentrates only on a 
few distinct values [29]). Hence, using the naive upper-bound (25) gives T = with 



high probability. This is very close to the best possible convergence time in case (i) but far from 
the best possible convergence time in case (ii). 

Small world graphs 

The Erdos-Renyi model does not capture many spatial and structural aspects of social networks 
and, hence, is not a realistic model of social networks Il28ll . Motivated by the small world 
phenomenon observed by Milgram If30l. Strogatz- Watts [31] and Kleinberg [[321 proposed models 
that illustrate how graphs with spatial structure can have small diameters, thus, providing more 
realistic models of social networks. We consider a variant of these models, proposed in |[28Tl . and 
characterize the convergence time to equilibrium in presence of stubborn agents. We consider 
two-dimensional graphs for simplicity but results are extendable to the higher dimensional graphs 
as well. 

Start with a social network as a grid y/n x y/n of n nodes. Hence, nodes i and j are neighbors 
if their l± distance ||i — j\\ = \%i — Xj\ + \yi — Vj\ is equal to 1. Following the arguments for 
the bounded-degree graphs with fixed number of stubborn agents, T = 0(n5), and in the grid, 
5 = 2y/n obviously, which yields T = 0(riy/n). Note that changing the location of the stubborn 
agents can change the convergence time only by a constant and does not change the order. 

Now assume that each node creates q shortcuts to other nodes in the network. A node i 
chooses another node j as the destination of the shortcut with probability ^ " ^_ k ^- a , for some 
parameter a > 0. Parameter a determines the distribution of the shortcuts as large values of a 
produce mostly local shortcuts and small values of a increase the chance of long-range shortcuts. 
In particular, q = 1 and a = recovers the Strogatz- Watts model where the shortcuts are selected 
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uniformly at random. It is shown in ll33Tl that for a < 2, the graph is an expander with high 
probability and hence, using the inequality between the diameter and the spectral gap ll38ll . its 
diameter is of the order of O(logn) with high probability. We also need to characterize the 
maximum degree in such graphs. The following lemma is probably known but we were not able 
to find a reference for it, hence, we have included its proof in Appendix [F] for completeness. 

Lemma 9. Under the small-world network model, d max = O(logn) with high probability. 



Hence, putting everything together, using the upper-bound (25), we get T = 0(n log 2 n). This 
ffers from the si 
Vt{l) in case (ii). 



differs from the smallest possible convergence time in case (i) by a factor of log 2 n but far from 



V. Concluding Remarks 

We viewed opinion dynamics as a local interaction game over a social network. When there 
are no stubborn agents, the best-response dynamics converge to a common opinion in which 
the impact of the initial opinion of each agent is proportional to its degree. In the presence of 
stubborn agents, the dynamics converge to an equilibrium in which the opinion of each agent 
is a convex combination of the initial opinions of the stubborn agents. The coefficients of such 
convex combination are related to appropriately defined hitting probabilities of the random walk 
over the social network's graph. An alternative interpretation is based on an electrical network 
model of the social network where, at equilibrium, the opinion of each agent is simply its voltage 
in the electrical network. 

The bounds on the convergence time in the paper can be interpreted in terms of location 
and stubbornness levels of stubborn agents, and graph properties such as diameter, degrees, 



and the so-called bottleneck constant (20). The bounds provide relatively tight orders for the 
convergence time in the case of a fixed number of partially stubborn agents (case (i)) but there 
is a gap between the lower-bound and the upper-bound when some of the stubborn agents are 
fully stubborn (case (ii)). Tightening the bounds in case (ii) remains as a future work. 

At this point, we discuss the implication of our results in applications where limited advertising 
budget is to be used to convince a few agents to adopt, for example, a certain opinion about a 
product/topic. The goal is the optimal selection of such agents to trigger a faster spread of the 
advertised opinion throughout the social network. This, in turn, implies that, over a finite time, 
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more agents will be biased towards the advertised opinion. Similar leader selection problems 
have been discussed in lfT2l . 0, [fTTl for different applications where the goal is to select a 
set of M agents with fixed states to optimize the system performance such as minimizing the 
convergence time to consensus |fT2l| . minimizing the error when the observations are noisy ||5|, 
or maximizing the impact of stubborn agents on the long-run expected opinions of the agents 
0/71 • The common methodology is to show that the objective is a sub-modular set function and 
use the sub-modular optimization framework in, e.g., 11401 . to produce a greedy procedure where 
agents are added according to a greedy sequence. Although the greedy algorithm is useful, it 
does not answer the question in its simplest form M = 1, and may involve the inversion of 
typically large matrices lfT2l in social networks with very large number of users. 



Using the simple bound (22), the question is reduced to where to place a fixed number of 
fully-stubborn agents in order to minimize \^\Bd. Recall that 7 is the maximum length of 
shortest paths from non-stubborn agents to stubborn agents, B is the bottleneck constant defined 



in (20), and d is the maximum degree of non-stubborn agents. Since empirical graphs of social 
networks exhibit small- world network characteristics, | | is already very small (it is less than 
the diameter of the graph which is already a logn quantity), and hence, the product B ■ d is 
the dominating factor. It is believed that degree distribution in many networks, such as social 
networks, Internet topology, WWW induced graph, Hollywood graph, etc, follows a power-law 
distribution (see Il39l for a survey with more examples). Heuristically, when there are a few very 
high degree nodes and most of the nodes are of low degrees, selecting the high degree nodes, as 
stubborn agents, reduces d dramatically and also reduces B because many agents (the neighbors 
of the stubborn agents) are now directly connected to the stubborn agents. On the other hand, 
selecting the possibly low degree nodes of bottleneck edges as stubborn agents reduces B but 
this reduction is at most by a factor equal to low degrees of such nodes. Therefore, in general, 
the high degree nodes seem to be good candidates for placement of stubborn agents. It will be 
certainly interesting to establish the validity of such a heuristic more rigorously. 

Appendix A 
Proof of Lemma[2] 

A similar result as Lemma [2] is standard when analyzing the convergence of the probability 
distribution of a Markov chain. Opinion dynamics are different than probability evolution in 
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Markov chains, but the same ideas as in the case of probability distributions also work when 
analyzing the convergence of opinion dynamics. We present the proof of Lemma [2] here for 
completeness. 

We can compute the error recursively as follows. 

e(t + 1) = Ax(t) - l n vr T x(0) - l n rr T x{t) + l n 7r T x{t) (26) 

= Ax{t) - Al n n T x(0) - l n 7c T x{t) + l n vr T A*x(0) (27) 

= Ax(t) - Al n 7c T x{0) - l n 7i T x{t) + l n vr T x(0) (28) 

= Ax{t) - Al n n T x(0) - l n 7c T x{t) + l n 7r T l„7r T x(0) (29) 

= (A-l n n T )(x(t) -l n n T x(0)) (30) 

= (A-t n 7t T )e(t). (31) 

(A, it) is reversible, thus D 1 / 2 AD~ l l 2 is a symmetric matrix where D = diag(7r). Then, it is well- 
known, e.g., see [0, that A has real eigenvalues and n distinct right eigenvectors vi,v 2 , • • • ,v n 
and n distinct left eigenvectors m, ■ ■ ■ u n such that m = Dvi. So, it follows from orthogonality 
of left and right eigenvectors that (v^Vj)^ = <5y, where 5ij = 1 if i = j and is zero otherwise. 
Therefore, we have 

(A - l„7T T )l n = l n - t n = 

and, for i > 2, 

(A - l n 7T T )vi = XiVi - l n n T Vi = XiVi, 
Following standard line of arguments as in [6], e(t) = YM=i( e (^)^ v i)^ v i- therefore, 

n 

(A - l n 7T T )e(t) = k(e(t),Vi) n Vi. 

i=2 

and 

n 

\\e(t+i)\\i = ^xim^iMi 

i=2 
n 

= £A?<e(*),«<)£ 
i=2 

n 

< P iY,«t),vi)i 

i=2 

= Pl\\e(t)\t 
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where p 2 : = max^i |A;| is the SLEM of A. So \\e{t + 1)11^ < /0 2 ||e(i) H^, and, accordingly, 

||e(t)|U<p' 2 ||e(0)|U. 

Appendix B 
Proof of Lemma[3] 

The transition probability matrix of the random walk over Q is given by 

p_ A nxn B nx \ Sp \ 

I|5 P | is the identity matrix of size |<Sp|, i.e., when the walk reaches m, it returns to its corre- 
sponding stubborn agent i with probability 1. Nonzero elements of A correspond to transitions 
between vertices of V. Nonzero elements of B correspond to transitions from a partially stubborn 
agent i E Sp to u%. The matrices A and A only differ in the rows corresponding to agents Sp 
which are all-zero rows in A. Notice that Xi(t) = Xj(0) for all % E Sp and t > 0. Hence, we can 
focus on the dynamics of x(t) = [xi(t) : i E V\Sp] T . 

Let A be the matrix obtained from A (or A) by removing rows and columns corresponding 
to fully stubborn agents Sp. Let A Sp denote the columns of A corresponding to Sp. Let B be 
the matrix obtained from B by (i) replacing the columns corresponding to fully stubborn agents 
Sp with A Sp (or A Sp ), (ii) removing rows corresponding to S F , (iii) removing the columns 
corresponding to non-stubborn agents (which are all zero columns). Then, we have 

x(t + l) = Ax(t) + Bx s (0). 

where 0:5(0) = [xi(0) : i E S] T . Note that both A and A have the same largest eigenvalue, i.e., 
= Aj[. The dynamics converge to the equilibrium x(oo) = (I — A)~ 1 Bxs(Q). 
For each vertex i E V, and j E Sp, let Fij := Pj(r = Tj) be the probability that random walk 
hits j first, among vertices in Sp U u(Sp), given the random walk starts from vertex i. Also, 
for each vertex i E V, and Uj E u(Sp), let F^ := Pj(r = r Uj ) be the probability that random 
walk hits Uj first, among vertices in Sp U u(Sp), given the random walk starts from vertex i. 
Then, we have the following recursive formulas for the F^ probabilities. For every i E V\Sp 
and every j E S F , 

Fj = + ^ A ik F k j, (33) 

k£V\S F 
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and for every % E V\S F and every j E S P , 

Fij = + 2J A ik F k j. (34) 

Note that B is [_Bv4s F ] without the rows corresponding to <Sp. Hence, putting the two equations 
together in the matrix form, F = B + AF or F = (I - Ay 1 !}. 

Note that for any i E Sf, Fa = 1 and Xi(t) = Xi(0) at all times t > 0. Hence, the equilibrium 
at each node i E V, is a convex combination of initial opinions of stubborn agents, where 

Xi{oo) = J2 F v x M- (35) 



Appendix C 
Proof of Lemma|4] 

Recall graph Q with edge weights {wij : E E}. By and taking the limit as t — > 00, 
the equilibrium is the solution to the following set of linear equations 

Xi(oo) = — y^WijXj(oo), (36) 

for each node i E V, with boundary conditions x Ui (oo) = Xi(0), i E Sp, and Xi(oo) = Xi(0) for 
i E Sf- Now assume each edge (i, j) E £ has a conductance u;^ and vertices Sf U u(Sp) are 
voltage sources where the voltage of each source i G Sp is Xj(0) volts and the voltage of each 
source Uj E u(Sp), j E Sp, is Xj(0) volts. Let Vi be the voltage of node i. Kirchhoff's current 
law states that the total current entering each node must be zero, i.e., for each node i E V\Sf, 
J2jedi w ij( v i ~ v j) = or equivalently, 

WiVi = WijVj (37) 



which, comparing to (36), shows that £j(oo) = V{. Note that having a fully stubborn agent i, 
with Ki = 00, corresponds with connecting i to a fixed voltage of Xj(0) volts with an edge of 
infinite conductance (short circuit). Hence, AVs can be interpreted as the internal conductance 
of the voltage sources. A fully stubborn agent i with K \ = 00 corresponds to an ideal voltage 
source with zero internal resistance. 
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Appendix D 
Proof of Lemma[5] 

From the definition of e(t), 

t—l oo 

e{t) = A'x(O) + ^A s 5x(0) - J2 ASBx (°) 

s=0 s=0 

oo 

= A l x(0) -^A s 5x(0) 

s=t 

(oo 
x(0) -^A s 5a;(0) 

Hence e(t + 1) = Ae(t). Let A a denote the largest eigenvalue of the irreducible sub- stochastic 
matrix A. Trivially ej(t) = for all fully stubborn agents i G Sf- Let e(t) := (ej(t) : i G V\iS>f) t 
denote the vector of errors without the fully stubborn agents. Then e(t) = Ae(t— 1) holds, where 
A is the matrix obtained from A by removing rows and columns corresponding to agents Sf- 
Note that A and A have the same largest eigenvalue, i.e., \a = A^. 

Consider the Markov chain defined by P in ([32]). It is easy to check that P is reversible 
with respect to a distribution n = (jii = y : i 6 V) T where u>i is the weighted degree of 



vertex i, given by (12), and Z = 2(\£\ + J2 i£Sp Ki) is the normalizing constanj^J Note that 
niAij = ftjAji holds for all i, j G V\Sp- By minor abuse of terminology, we would also call 
A reversible with respect to the distribution n = (^Ki/n(A) : i G V\Sf^J , where ir(A) is the 
normalization constant. Let D = diag(7r). Then, using the same trick as in the characterization 
of eigenvalues of a reversible stochastic matrix, A* = D 1 / 2 AD~ 1 / 2 is symmetric and has the 
same (real) eigenvalues as A. Moreover A* is diagonalizable with a set of equal right and left 
eigenvectors 01 , ■ ■ ■ , 9 n -\s F \. Correspondingly, if u±, ■ • ■ , u n -\s F \ denote the left eigenvectors of 
A and v i, - • • , v n ^\s F \ denote its right eigenvectors, it should hold that Ui = Dvi. Also from the 
orthogonality of 9[s, we have (ui, = and {vi,Vj)n = 5ij. Using {vi, ■ ■ ■ , ?V-|s P |} as a 

base for R"-I 5 ^l, e(t) can be expressed as 

n-\S F \ 

e(t) = (e(t),Vi)zVi, 

i=l 

6 By definition of reversibility, iiiPij = i^jPji for all i,j 6 V 
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SO 



Therefore, 



i=i 



8=1 

n 

= X)A?(e(t),T; 4 >? 



2|| ||2 



i=l 



< A^J>(f),i;«)| 



i=l 

So ||e(t + l)||* < X A \\e(t)h- Accordingly, ||e(t)|| ff < A* A ||e(0)|| # . 

Appendix E 
Proofs of Lemmas [5J, |7} and [8] 

The three Lemmas are based on the extremal characterization of the eigenvalues. First, we 
present an extremal characterization for the largest eigenvalue of a sub-stochastic (and reversible) 
matrix. Then, we state the proofs of individual lemmas. 

A and A have the same largest eigenvalue (recall that A is obtained from A by removing rows 
and columns corresponding to fully stubborn agents Sp, as in Appendix .). Consider the Markov 



chain defined by P in (32). P is reversible with respect to 7r = (jr^ = y : i 6 V) T where u>« is 
the weighted degree of vertex i, given by ( 12), and and Z = 2(\£\ + J2i£S P ^i) * s me normalizing 



constant. Note that KiAij = HjAji holds for all i,j E V\Sp- By minor abuse of terminology, 
we would also call A reversible with respect to the distribution n = (ni/ix(A) : i G V\<Sp^ , 
where n(A) is the normalization constant. Thus, it follows from extremal characterization of 
eigenvalues B2H, IH that 

1 - A x = inf «L^£/>i 

where the infimum is over all functions / : V\Sf — > H- The above characterization can also be 
written as 



e*« if, f), 
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where now the infimum is over all functions g : V — > R with g(Sp) = 0. Recall the random 
walk over the weighted graph Q(V,£) with transition probability matrix P (32). Equivalently, 
we can also write the characterization as 

. t ((I-P)^ 
1 - Aa = mf — — . 

<^0 (0, 0),, 

where now the infimum is over functions '■ V — )• R, such that (<Si? U u(Sp)) = [^J Then, 
((I — P)0, 0)„. = £(0, 0) where £(0, 0) is the Dirichlet form 

which, in terms of the edge weights of Q, is equal to 



2w 

i,jev 



where w := J2itv w i- Similarly, 



1 E 

i6V\5 F 



Wi(h 2 {i). 



Define a path from vertex i to vertex j, as a collection of oriented edges that connect i to j. 
For any vertex i G V\Sf, consider a path 7^ from i to the set Sf U u(Sp) that does not intersect 
itself, i.e., 7j = («i,i 2 ), • •• ,(^ m ,j)} for some j G u(Sp). Then, we can write 

#) = E ( ^ )e7l (^)-0(2/))- 

Proof of Lemma [6f The result follows from the extremal characterization of 1 — Xa- Note 

that 



^ E «* I E w*) - ^(f )) 



^ E ^ E t=v^(^)-^)) 



<1e4E^ E ^(0(x)-0(y)) 2 (38) 



10 z — ' \ * — ' w xv , , 

i&V\S F \{x,y)eji y I \{x,y)&ii 



7 It is worth pointing out that function /, accordingly g or <j>, that achieves the infimum is the right eigenvector corresponding 
to Xa and from Peron-Ferobenius theorem, it must be nonnegative. 
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1 E 

w ^ 



Wi\ji 



w xy {<j){x) - 4>{y)f 



i€V\S F 



x,yeV \i:jiB(x. 



Wi\li\w 



y) 



(39) 



This concludes the proof. Inequality (38) is an application of Cauchy-Schwarz inequality. I 
Proof of Lemma U\ The proof is again based on the extremal characterization. Note that 

(<f>(x) - <f>(y)) 

\0,j/)e7i 



< 



1 E 

iev\s 

1 E 

in J—^ 



■W: 



Willi 



{<K*)-<Kv)y 



(40) 



iev\s F 



(a:,y)G7i 



Willi 



x,yEV 



1 . 1 

-^ w M{ x )-4>{y)) 2 — 



Willi 



x,yEV 



xy i-.fiB(x,y) 



(41) 



which concludes the proof. Inequality (40) follows from Cauchy-Schwarz inequality. ■ 
Proof of Lemma^ To find an upper bound on 1 — \a, consider indicator functions of the 
form ls(z), B C V\S F , in the extremal characterization of eigenvalues. Then, we have 



1-Xa < 



EieB Wi 

And accordingly, 1 — < min B cv\5 F i>(B]G)- It is easy to see that the minimizing B is the 
vertex set of a connected subgraph of Q\Sp in the above minimization. ■ 
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Appendix F 
Proof of Lemma[9] 

First, we show that the mean degree is less than a constant for all n for all a > 0. 

Z>-*ir a ^ Ew ra >/ rtx = — ((v^/2) 2 ^-i) 

> fora/2 , 

2 — a 

and log(vW2) for a = 2. For any node u, d u < 4 + q + J27=i,i^u YH=i X is> where X is is 
a Bernoulli random variable indicating if the s-th shortcut, 1 < s < q, from i is connected 
to u or not. Hence d u is the summation of (n — l)q independent random variables which are 
not necessarily identically distributed except those random variables that correspond to shortcuts 
from the same node. Let d„ := E oL . Hence 



2v^ _ 

2 - a f r 2 V^+i 

5 i+q+q wmr^ l+ L x dx 

= 4 + « + «(^7^( 1 + 2^ (2 ^ +1) "°- 1) ) 

< 4 + g + 2g6 2 ~ a < 77q 

and for « = 2, 

d u < 4 + g + g- — (1 + / 

log(Vn/2) V J x 

= 4 + g + g 1 (l + log(2v^ + 1 
log(v/n/2) V 

< 4 + q + Aq < 9q 

Next, we use the following version of the checkoff bound for summation of independent, but 
not identically distributed, Bernoulli random variables (Lemma 2.4 of I12810 . 



P (d u - d u > ed u ) < exp(-h(e)d u ) 
where h(x) := (1 + x) log(l + x) - x. Let e = 1 °P, then /i(e) > ^(log - 1), thus, 
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By the union bound 

P (3U : d u - d u > ed u ) < n 2+log(7 7(? )-loglogn_ 

so, as n — > oo, d max = O(logn) with high probability. 
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